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Abstract 

Background: The stigma of schizophrenia constitutes a major barrier to early detection and treatment of this 
illness. Anti-stigma education has been welcomed to reduce stigma among the general public. This study examined 
the factors associated with the effectiveness of a web-based educational program designed to reduce the stigma 
associated with schizophrenia. 

Methods: Using Link's Devaluation-Discrimination Scale to measure stigma, the effect of the program was 
measured by the difference in pre- and post-program tests. In the present study, we focused on program 
participants whose stigma towards schizophrenia had considerably improved (a reduction of three points or more 
between pre- and post-program tests) or considerably worsened (an increase of three points or more). The study 
participants were 1,058 parents of middle or high school students across Japan, including 508 whose stigma had 
significantly decreased after the program and 550 whose stigma had significantly increased. We used multiple 
logistic regression analysis to predict a considerable reduction in stigma (by three or more points) using 
independent variables measured before exposure to the program. In these models, we assessed the effects of 
demographic characteristics of the participants and four measures of knowledge and views on schizophrenia 
(basic knowledge, Link's Devaluation-Discrimination Scale, ability to distinguish schizophrenia from other conditions, 
and social distance). 

Results: Participants' employment status, occupation, basic knowledge of schizophrenia, pre-program Link's 
Devaluation-Discrimination Scale score, and social distance were significant factors associated with a considerable 
decrease in the stigma attached to schizophrenia following the educational program. Specifically, full-time and 
part-time employees were more likely to experience reduced stigma than parents who were self-employed, 
unemployed, or had other employment status. Considerable decreases in stigma were more likely among parents 
working in transportation and communication or as homemakers than among other occupational groups. 
In addition, parents with higher pre-program levels of stigma, lower basic knowledge, or lower social distance were 
more likely to have reduced levels of stigma. 

Conclusions: Based on the regression analysis results presented here, several possible methods of reducing stigma 
were suggested, including increasing personal contact with people with schizophrenia and the improvement of 
law and insurance systems in primary and secondary industries. 
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Background 

The first episode or prodromal symptoms of schizophre- 
nia typically occur in adolescence [1,2]. However, stigma 
towards schizophrenia is one of the most important fac- 
tors related to the obstruction of its early detection and 
treatment [3,4]. Therefore, it is vital to decrease stigma 
among parents of adolescents to contribute to the re- 
moval of this barrier [5]. There have been many studies 
on demographic and social characteristics associated with 
stigma towards schizophrenia, including educational at- 
tainment, occupation, and previous contact with people 
with schizophrenia [4,6,7]. However, the factors that create 
stigma among parents of adolescents have rarely been 
researched. A notable exception is a recent study by 
Yoshii [8] that showed that the factors reducing the risk of 
stigma associated with schizophrenia in Japanese parents 
were family income, previous contact with people with 
schizophrenia, and participation in welfare activities for 
people with mental illness. 

In recent decades, various educational programs have 
been developed aimed at reducing the stigma associated 
with schizophrenia. For example, a video about schizo- 
phrenia was played for 571 students from eight high 
schools across Canada [9]. In another example, a video- 
based education program was implemented among 255 
students from three middle schools in Hong Kong [10]. 
In both cases, post-program tests found that students 
displayed significantly less stigma towards schizophrenia 
than before the program. Nonetheless, there has been no 
educational program specifically developed for the parents 
of adolescents, and hardly any studies on the factors asso- 
ciated with the effectiveness of educational programs. Be- 
cause stigma reduction is beneficial for early detection 
and treatment for adolescents developing their first epi- 
sode of schizophrenia, it is vital to expose parents to such 
programs. This study therefore evaluated the effect of a 
web-based educational program for parents of adolescents 
across Japan. Additionally, the factors associated with the 
effect were explored through multivariate analysis. The re- 
sults should contribute to the more effective design of fu- 
ture educational programs. 

Methods 

Participants 

The internet-based survey was conducted by a Japanese 
survey company. The sampling frame for this study was 
a total of 44,000 people listed in a database administered 
by this company as the parents of middle and high 
school students in Japan. From this group, a sub-sample 
of 5,000 parents was drawn using stratified random sam- 
pling (stratified by gender and place of residence). Of 
these parents, the 2,690 who agreed to participate in the 
survey answered a questionnaire about their geograph- 
ical characteristics and living environment and then 



completed additional questionnaires about their know- 
ledge of and views on schizophrenia, including Link's 
Devaluation-Discrimination Scale for measuring stigma, 
both before and after watching an educational program. 
We refer to the tests about stigma administered before 
and after the program as the "pre-program test" and the 
"post-program test". The interval between pre- and post- 
program tests was 1 week, and 2,465 parents completed 
the post-program test. All participants used a web-based 
questionnaire-answering system provided by the com- 
pany conducting the survey. The present study design is 
a one-group pre-test and post-test design. Changes in 
stigma score ranging from -2 to 2 points were consid- 
ered not to be significantly affected by the educational 
program, so the characteristics of parents with that level 
of change could not be used effectively to explore causal 
factors of educational effect. The final participants in- 
cluded in this study were therefore limited to the 1,058 
parents whose absolute differences between pre- and 
post-program stigma scores were 3 points or more. Writ- 
ten informed consent for participation in the study was 
obtained from all participants. This study was approved 
by the Medical Ethics Committee of Niigata University. 

Demographic factors 

The demographic factors and the corresponding categor- 
ies used in this study are shown in Table 1. Parents' educa- 
tional attainment was split into four categories: middle/ 
high school, vocational school, junior college, and univer- 
sity and graduate school [11]. Place of residence was 
also divided into four groups: northern region (Hokkaido/ 
Tohoku), east-central region (Kanto/Shin-etsu/Hokuriku), 
west-central region (Tokai/Kinki), and western region 
(Chugoku/Shikoku/Kyushu/Okinawa). Employment status 
was divided into three categories: employed full-time, 
employed part-time, and other (self-employed, working 
in family business, or unemployed). There were seven 
occupational categories: production labor service, trans- 
portation and communication, sales and marketing, ser- 
vice industry, professional, homemaker, and other. Family 
income consisted of five categories: < 11,000; 11,000- 
32,000; 32,000-53,000; 53,000-110,000; and > 110,000 US 
dollars [8,11]. 

Measures of schizophrenia stigma and knowledge 

Link's Devaluation-Discrimination Scale modified for 
schizophrenia was used for measuring the stigma at- 
tached to schizophrenia among parents of middle and 
high school students (Additional file 1). This scale mea- 
sures the extent to which a respondent believes that most 
people would devalue or discriminate against people with 
schizophrenia now or in the past [12,13]. The form of the 
scale attributes responses to an external population and 
encourages the free expression of negative attitudes. In 
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Table 1 Descriptive statistics on demographic factors and 
stigma scales for stigma-increased and stigma-decreased 
groups (n = 1,058) 

'Stigma- 'Stigma- 
increased' decreased' 



group 



group 





(n = 


550) 


(n = 


508) 






N 


% 


n 


% 


P 


lemographic factors 












Age (years) (Mean ± S.D.) 


46.4 ± 4.5 


45.9 ± 4.5 


0.1 79 a 


Gender 










0.804 b 


Male 


303 


55.1 


276 


54.3 




Female 


247 


44.9 


232 


45.7 




Children's status 










0.568 b 


Junior school students 


274 


49.8 


262 


51.6 




Senior high school students 


276 


50.2 


246 


48.4 




Education 










0.227 b 


Junior and senior high school 


140 


25.5 


154 


30.3 




Vocational school 


70 


12.7 


69 


13.6 




Junior college 


80 


14.5 


74 


14.6 




University and graduate school 


260 


47.3 


211 


41.5 




Current residence 










0.242 b 


Hokkaido/Tohoku 


59 


10.7 


59 


11.6 




Kanto/Shin-etsu/Hokuriku 


248 


45.1 


204 


40.1 




Tokai/Kinki 


180 


32.7 


169 


33.3 




Chugoku/Shikoku/Kyushu/ 
Okinawa 


A3 

oo 


1 1 Q 
I I .J 


/o 


I j.U 




Married 










0.564 b 


Yes 


527 


95.8 


483 


95.1 




Mn 
J (J 


23 


4.2 


25 


4.9 




Family structure 










0.084 b 


Nuclear family 


439 


79.8 


383 


75.4 




Other 


111 


20.2 


125 


24.6 




Employment status 










0.21 2 b 


Full-time 


288 


52.4 


273 


53.7 




Part-time 


76 


13.8 


85 


16.7 




Other 


186 


33.8 


150 


29.6 




Occupation 










0.014* b 


Production labor service (Mining/ 
Construction/Manufacturing/ 
energy industry) 


137 


24.9 


106 


20.9 




Transportation and 
communication 


23 


4.2 


36 


/.I 




Sales and marketing (Wholesale 
and retail/Finance and insurance/ 
Real estate) 


// 


14.0 


68 


13.4 




Service industry (Catering and 
lodging, etc.) 


58 


10.6 


64 


12.6 




Professional (Medical and 


93 


16.9 


104 


20.5 





Table 1 Descriptive statistics on demographic factors and 
stigma scales for stigma-increased and stigma-decreased 
groups (n = 1,058) (Continued') 



Homemaker 


115 


20.9 


108 


21.2 




Other 


4/ 


8.5 


22 


4.3 




Family income per year 
(US dollars) 










0.733 


< 11,000 


8 


1.5 


9 


1.8 




1 1 ,000-32,000 


48 


8.7 


35 


6.9 




32,000-53,000 


98 


17.8 


84 


16.5 




53,000-110,000 


296 


53.8 


289 


56.9 




>1 10,000 


100 


18.2 


91 


17.9 




Proximity to person with 
schizophrenia 










0.564 b 


Yes 


21 


3.8 


23 


4.5 




No 


529 


96.2 


485 


95.5 




Participation in welfare activities for 
people with mental illness 








0.463 b 


Yes 


49 


8.9 


52 


10.2 




No 


501 


91.1 


456 


89.8 





Factors obtained before watching the 
program 

Examination of basic 
knowledge (Mean ± S.D.) 



1 0.8 ± 1 .3 1 0.8 ± 1 .2 



0.914" 



Pre-program Link's 
Devaluation-Discrimination 
Scale (Mean ± S.D.) 

Examination of ability to 
distinguish schizophrenia from 
other disorders (Mean ± S.D.) 

Social distance scale 
(Mean ± S.D.) 



30.6 ±4.2 35.8 ±4.7 <0.001* 



1 2.0 ± 2.8 1 2.2 ± 2.9 0.357 a 



1 2.0 ± 4.5 1 2.5 ± 4.3 0.052" 



welfare/Education industry/ 
Public officer) 



a Mann-Whitney U test. 

b Pearson's chi-squared test. 

*Two-tailed significance with P-values < 0.05. 

other words, the scale is designed to reduce, to some 
extent, intentionally benign reactions [14], Addition- 
ally, this scale could be completed by both normal 
people and those with schizophrenia [14]. The meas- 
ure consists of 12 four-level Likert-type items with higher 
values indicating stronger stigma (1: strongly disagree, 
2: tend to disagree, 3: tend to agree, 4: strongly agree). 
As previously mentioned, this scale was administered 
twice, once before and once after participants watched 
an educational program. Additionally, the difference 
between the pre- and post-program scores on Link's 
Devaluation-Discrimination Scale was calculated to 
assess the change of stigma score. 

The level of basic knowledge about schizophrenia and 
the ability to identify and distinguish it from other con- 
ditions were measured by two questionnaires consisting 
of 14 and 19 "True or False questions." The latter scale 
was based on the Diagnostic and Statistical Manual of 
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Mental Disorders, Fourth Edition, Text Revision criteria 
for schizophrenia and the PRIME Screen [9,15,16]. 
Social distance was evaluated by the Social Distance Scale- 
Japanese version, which consists of eight four-level Likert- 
type questions [8,11,16,17]. 

Web-based educational program 

An internet-based multimedia slideshow program was 
developed by Yoshii et al. and shown to parents [8,11]. 
The program aimed to provide basic knowledge about 
schizophrenia to reduce stigma. The program covered 
characteristics, causes, symptoms, and classification of 
schizophrenia as well as the course of the disease and its 
characteristic clinical features, treatment and prognosis, 
methods of preventing progression and exacerbation, 
signs of progression, and consultation facilities. Partici- 
pants could complete this program within 13 minutes by 
viewing 12 slides on the same website that delivered the 
survey questionnaires. 

Statistical analysis 

All statistical analyses were performed using IBM SPSS 
Statistics for Windows version 20.0 (Armonk, NY: IBM 
Corp.) Means (± standard deviations) were used to 
characterize the distributions of continuous variables. 
The Shapiro-Wilk test was used to assess the normality 
of the distribution. The Mann-Whitney U test was used 
to compare the medians in the distributions of continu- 
ous variables between groups in which stigma towards 
schizophrenia increased and the group where it de- 
creased. Pearson's Chi-squared test was conducted to 
test the equality of proportions among the groups. The 
Wilcoxon signed-rank test was used to compare the 
distribution of the scores between pre- and post-program 
tests for each item of Link's Devaluation-Discrimination 
Scale. Multiple logistic regression analysis with forward 
stepwise model selection was used to explore the factors 
significantly associated with considerable changes in the 
stigma scale. Candidate independent variables and sig- 
nificant influencing factors are shown in Table 1. The 
dependent variable in the multiple logistic regression 
models concerned two events: a considerable stigma in- 
crease and a considerable stigma decrease. The stigma 
changes were calculated by subtracting the post-program 
stigma score from the pre-program stigma score for 
each individual. As is described above, we chose changes 
with an absolute value of three points or more to repre- 
sent considerable changes. The logistic regression models 
predicted the odds of a being in the "stigma-decreased" 
group (changes equal to or greater than 3, coded as 1), 
compared with the odds being in the "stigma-increased" 
group (coded as 0). Nominal or ordinal variables with 
more than two categories were transformed to 0-1 design 
variables. The reference categories of these variables 



are described in the results for the independent vari- 
ables. For the multiple logistic regression analysis, the 
null hypothesis is that none of the independent vari- 
ables affects the probability of observing the value of 
0 or 1 on the dependent variable. All statistical tests 
were two-tailed, and statistical significance was de- 
fined as P < 0.05. 

Results 

Participant characteristics 

Table 1 shows the descriptive statistics of the partici- 
pants disaggregated by "stigma-increased" or "stigma-de- 
creased" group. The mean ages of the parents in the 
stigma-increased group and the stigma-decreased group 
(± standard deviation) were 46.4 ± 4.5 and 45.9 ± 4.5 years, 
respectively. The stigma-increased group was 44.9% fe- 
male, and the stigma-decreased group was 45.7% female. 
The percentages who came from nuclear families were 

79.8 and 75.4%, and the percentages who were part-time 
workers were 13.8 and 16.7% in the stigma-increased 
and stigma-decreased groups, respectively. The per- 
centages working in the production labor service sec- 
tor were 24.9 and 20.9%, the percentages working in 
transportation and communication were 4.2 and 7.1%, 
and the percentages working as professionals were 

16.9 and 20.5% for those in the stigma-increased and 
stigma-decreased groups, respectively. The means ± 
standard deviation of parents' scores on the social 
distance scale were 12.0 ± 4.5 and 12.5 ± 4.3 for the 
stigma-increased group and the stigma-decreased group, 
respectively. 

Distribution of pre- and post-program link's "stigma 
scales" 

Average scores on Link's Devaluation-Discrimination 
Scale for each participant were calculated by taking 
the mean of scores on the 12 scale items. Based on 
this average stigma score, participants were divided 
among four stigma level categories. To describe an indi- 
vidual participant's stigma level, participants were labeled 
as having a "minimal" (overall stigma score < 2), "low" (> 2 
but < 2.5), "moderate" (> 2.5 but < 3), or "high" (> 3) 
stigma level [13,18]. Those with a minimal or low 
level of stigma in the pre-program test showed a ten- 
dency towards increasing stigma levels in the post- 
program test. Among parents with moderate and high 
stigma levels in the pre-program test, 24.7 and 60.0%, 
respectively, showed reduced levels of stigma in the 
post-program test. There were 321 parents who exhib- 
ited higher levels of stigma towards schizophrenia after 
watching the program and 331 parents who showed de- 
creased levels. The paired distributions of pre- and post- 
program tests were not significandy different (Wilcoxon 
signed-rank test; P = 0.747) (Table 2). 
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Table 2 Change of the mean score on Link's Devaluation-Discrimination Scale from pre-test to post-test 



Mean scores of pre-link's Mean scores of post-ink's devaluation-discrimination scale 



devaluation-discrimination scale 


Minimal (<2) 


Low (2-2.5) 


Moderate (2.5-3) 


High (>3) 


Total 


Minimal (<2) 


2 (10.0)* 


10 (50.0) 


7 (35.0) 


1 (5.0) 


20 (100.0) 


Low (2-2.5) 


15 (6.4) 


41 (17.4) 


168 (71.5) 


11 (4.7) 


235 (100.0) 


Moderate (2.5-3) 


2 (0.4) 


121 (24.3) 


241 (48.4) 


1 34 (26.9) 


498 (100.0) 


High (>3) 


0 (0.0) 


18 (5.9) 


165 (54.1) 


1 22 (40.0) 


305 (100.0) 


Total 


19 (1.8) 


190 (18.0) 


581 (54.9) 


268 (25.3) 


1058 (100.0) 



Two-tailed P-value of 0.747 for Wilcoxon signed rank-test for four-level mean scores of pre- and post-test stigma. 
*The number of participants is presented in each cell, with the percent of the subtotal of each row in parentheses. 



Characteristics associated with changes of total stigma 
scores 

To assess overall stigma changes, the means ± standard 
deviation of Link's Devaluation-Discrimination Scale in 
pre- and post-programs for the whole sample (2,465 par- 
ents) were 32.8 ± 4.4 and 32.8 ± 4.4, respectively. In 
terms of the difference between pre- and post-program 
scores on this scale, the mean ± standard deviation 
was -0.06 ± 3.71. The Wilcoxon signed-rank test was 
used to compare the paired distributions of pre- and post- 
program scores on Link's Devaluation-Discrimination 
Scale. The P-value of the test was 0.176, suggesting that 
the distributions of pre- and post-program stigma were 
not significantly different. What is more, of the 2,465 par- 
ents who completed both pre- and post-program tests, 
994 (40.3%) had a decreased stigma score. 

The results of univariate analyses for clarifying the 
characteristics of stigma-increased and stigma-decreased 
groups are also shown in Table 1. Parental occupation 
and pre-program score on the Devaluation-Discrimination 
Scale were extracted as significant factors associated with 
changes to the "stigma scale." Those working in transpor- 
tation and communication or the service industry, as well 
as professionals and homemakers, had relatively higher 
proportions in the stigma-decreased group. The mean 
total stigma score for the pre-program test in the stigma- 
decreased group (35.8 + 4.7) was significandy higher than 
the mean score for the stigma-increased group (30.6 ± 4.2) 
(Mann- Whitney U test; P < 0.001). 

Multiple logistic regression analysis was used to ex- 
plore the characteristics associated with changes in total 
stigma scores following the educational program (Table 3). 
First, we estimated a logistic regression model including 
only demographic characteristics as independent variables 
(Table 3-1). Employment status and occupation were se- 
lected as significant factors associated with a considerable 
decrease in stigma levels. The odds ratios of full-time and 
part-time employment status were estimated at 1.669 and 
1.897, respectively, indicating that parents in these cat- 
egories were more likely to have a reduced total stigma 
score than those in the "other" category. Working in 



transportation and communication or being a homemaker 
also made a reduction of the total stigma score more 
likely. This model correctly predicted the outcome for 
72.0% of the parents in the stigma-increased group and 
for 38.0% of parents in the stigma-decreased groups. 
Overall, the outcome category was correctly predicted for 
55.7% of the 1,058 parents in the model (data were ob- 
tained from Classification Table output in SPSS and are 
not shown in the tables). 

We then estimated a logistic regression model predicting 
a considerable reduction in stigma score including demo- 
graphic factors and the four measures investigated in the 
pre-program test as candidate independent variables (basic 
knowledge, pre-program Link's Devaluation-Discrimination 
Scale score, ability to identify and distinguish schizophrenia 
from other conditions, and social distance) (Table 3-2). 
These four measures showed the degree of recognition, 
knowledge, and stigma towards schizophrenia before 
watching the educational program. They were included in 
the model to explore the characteristics associated with 
stigma by investigating the link between stigma changes 
and the original degree of recognition, knowledge, and 
stigma towards schizophrenia, in addition to demo- 
graphic factors. Employment status and scores on basic 
knowledge, pre-program score on Link's Devaluation- 
Discrimination Scale, and social distance were selected as 
significant factors associated with a considerable decrease 
in total stigma score. Working part-time was significantly 
associated with a reduction in the total stigma score, with 
an estimated odds ratio of 1.758. The odds ratios for basic 
knowledge and social distance were estimated at 0.861 and 
0.850. This means that a one-point increase in either of 
these variables was associated with a decrease of approxi- 
mately 14-15% in the odds of having a decreased stigma 
score. In contrast, an increase in the pre-program Link's 
Devaluation-Discrimination Scale score resulted in in- 
creased odds of a reduction of the total stigma score. The 
correct outcome category was predicted for 79.5% of par- 
ents in the stigma-increased group and 73.4% of parents in 
the stigma-decreased group. The outcome was correctly 
predicted for 76.6% of parents, overall (data not shown). 
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Table 3 Multiple logistic regression models predicting difference between pre-test and post-test scores on Link's 
Devaluation-Discrimination Scale 



3-1 Results of multiple logistic regression analysis using only demographic variables to predict considerably decreased stigma* 


Variables 


Coefficients 


Std. error 


P 


Odds ratio 


95% 


CI 












Lower 


Upper 


Employment status 














Full-time 


0.512 


0.224 


0.022 


1.669 


1.077 


2.587 


Part-time 


0.640 


0.255 


0.012 


1.897 


1.151 


3.125 


Other** 






0.032 








Occupation 














Production labor service** 






0.004 








Transportation and communication 


0.716 


0.298 


0.016 


2.045 


1.141 


3.666 


Sales and marketing 


0.189 


0.215 


0.380 


1.208 


0.792 


1.840 


Service industry 


0.442 


0.237 


0.062 


1.557 


0.978 


2.478 


Professional 


0.366 


0.195 


0.061 


1.442 


0.984 


2.115 


Homemaker 


0.689 


0.280 


0.014 


1.992 


1.151 


3.448 


Others 


-0.463 


0.295 


0.117 


0.629 


0.353 


1.123 


Constant 


-0.752 


0.246 


0.002 


0.472 






3-2 Results of multiple logistic regression analysis using the significant demographic variables and four measures at pre-evaluation to 
predict considerably decreased stigma* 


Variables 


Coefficients 


Std. error 


P 


Odds ratio 


95% 


CI 












Lower 


Upper 


Employment status 














Full-time 


0.315 


0.170 


0.064 


1.370 


0.982 


1.912 


Part-time 


0.564 


0.231 


0.015 


1.758 


1.117 


2.767 


Other** 






0.037 








Knowledge score 


-0.150 


0.061 


0.015 


0.861 


0.763 


0.971 


Pre-program Link's Devaluation-Discrimination Scale 


0.359 


0.024 


<0.001 


1.432 


1.366 


1.502 


Social distance 


-0.162 


0.021 


<0.001 


0.850 


0.815 


0.887 


Constant 


-8.576 


0.890 


<0.001 


0.000 







"Dependent variable: 1 = stigma-decreased, 0 = stigma-increased. The two groups were defined by subtracting the total post-test score on Link's 
Devaluation-Discrimination Scale from the total pre-test score on Link's Devaluation- Discrimination Scale. The significant variables were selected using forward 
stepwise regression. Pre-evaluation measures include basic knowledge, pre-program Link's Devaluation-Discrimination Scale score, ability to identify and distinguish 
schizophrenia from other conditions, and social distance. 
**Reference category. 



Discussion 

In this study, demographic and social factors were 
used to characterize the changes in levels of stigma 
towards schizophrenia, which were measured by Link's 
Devaluation-Discrimination Scale before and after watch- 
ing an internet-based educational program. Among par- 
ents of Japanese middle and high school students, mean 
stigma scores before and after watching the educational 
program on schizophrenia were identical (32.8 ± 4.4), 
and our analysis comparing the distributions indicated 
that the pre- and post- program distributions were not sig- 
nificantly different (Wilcoxon signed-rank test P-value = 
0.176). The scores of pre- and post-program stigma found 
in the present study were similar to the stigma score re- 
ported by Berge et al. (32.86 ± 6.22) [19], suggesting that 



the result of this study measured by Link's Devaluation- 
Discrimination Scale is a typical result with litde fluctu- 
ation among the general population. 

The design of the present study, in terms of both the 
delineation of the working sample and the choice of the 
dependent variable, facilitated the detection of new find- 
ings. Besides the parents with considerably-changed stigma 
scores, there were also some whose stigma scores changed 
slightly. These slight changes could be caused by either the 
educational program or random error. Consequently, if all 
these heterogeneous participants were studied simultan- 
eously, it would be difficult to test the true educational ef- 
fect of the program [20]. We therefore studied only those 
parents who showed considerably increased or decreased 
levels of stigma towards schizophrenia. In addition, this 
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study is different from common multivariate analytical 
studies that have used stigma level as the dependent vari- 
able. Instead, we have explored the risk factors associated 
with the effectiveness of stigma-change through educa- 
tion. As a result, several little-known factors associated 
with stigma scores emerged, including employment status. 
In addition, we were able to highlight other important fac- 
tors that are easily overlooked, such as differences associ- 
ated with work status, occupation, and levels of basic 
knowledge. 

In the logistic regression analysis that included only 
demographic and social factors as independent variables, 
employment status and occupation were selected as sig- 
nificant factors associated with considerable changes in 
levels of stigma (comparing the odds of considerable de- 
creases to the odds of considerable increases). To the 
best of our knowledge, this is the first time that the ef- 
fect of employment status has been shown on stigma to- 
wards schizophrenia. The employment status described 
as "other" includes those who are self-employed, work- 
ing in family-owned businesses, and unemployed. The 
overwhelming majority of this group was unemployed 
(66.4%, data not shown). Compared with those with 
"other" employment status, levels of stigma were signifi- 
cantly more likely to decrease among both full- and 
part-time employees. The degrees of freedom of social 
contact are relatively high among full- and part-time em- 
ployees compared with the "other" group. In particular, 
unemployed and self-employed people have fewer oppor- 
tunities to be in contact with different kinds of people and 
ideas. In contrast, full- and part-time employees, such as 
doctors, salesmen, lawyers, and civil servants, come into 
contact with a wide range of people in their professional 
lives. This result for employment status and occupation, 
then, could be seen as meaning that people with wider 
social and interpersonal relationships were more likely 
to be affected by the program in terms of reducing levels 
of stigma towards schizophrenia. A previous study on so- 
cial contact and stigma indicated that people may be- 
come broader-minded and more accepting of difference 
through intergroup contact, with differences going beyond 
age and affinity orientation. It was also reported that re- 
quiring greater interpersonal disclosure may help to re- 
duce stigma [21]. 

The result on occupation type could be interpreted as 
a "stigma reduction" effect and a "degree of reduction 
difficulty" in different sectors. According to statistics of 
the Japanese Ministry of Health, Labour and Welfare [22] , 
the employment rate of mentally-disabled people is sig- 
nificantly lower than that of physically-disabled people 
(0.7 vs. 19.3%). Therefore, opportunities for contact with 
mentally-disabled people in the workplace are likely to be 
very limited. In addition, 70.7% of employed mentally- 
disabled people engage in the tertiary industry while only 



29.3% engage in other industries. This indicates that those 
engaged in the primary and secondary industries would 
have hardly any contact with mentally-disabled people. 
Thirty-five percent of the tertiary industry was the medical 
sector, and previous research has reported low stigma 
among doctors and nurses [23,24]. Furthermore, work- 
places in the tertiary industry are often offices, while other 
industries sometimes provide dangerous working condi- 
tions, such as a pelagic (tuna) fishing ship, a mine, or a 
welding factory, all of which often involve staff security is- 
sues. As reported in a study on the relationship between 
stigma and barriers to employment, people in industries 
using heavy machinery and dangerous equipment have 
higher levels of stigma against mental illness because of 
worries about the dangers to and of employees with men- 
tal illness [25]. Therefore, the program about schizophre- 
nia may have given the message to people engaged in 
these industries, with very little knowledge of or contact 
with mentally-disordered people, that they would have 
higher security needs around co-workers with mental ill- 
ness. There is a possibility that their surprise and hesita- 
tion might subconsciously cause increases in stigma levels. 
It has been previously reported that gender differences 
were found in public attitudes towards mental disorder 
and that females showed more emotional concern about 
mental health problems than did males [26,27]. This 
might indicate that gender difference was one of the rea- 
sons why homemakers in this study, who are mostly fe- 
male (96.9% homemakers were female, data not shown), 
showed lower levels of stigma towards schizophrenia. 

Apart from demographic and social characteristics, 
other factors surveyed before watching the program 
were also used as independent variables in the logistic 
regression analysis. These factors included the pre- 
program scores on Link's Devaluation-Discrimination 
Scale, basic knowledge about schizophrenia, social dis- 
tance, and the ability to distinguish schizophrenia from 
other disorders. These measurements of schizophrenia- 
associated stigma obtained before the educational pro- 
gram were incorporated in a second model to predict 
the stigma changes caused by the program. Knowledge, 
pre-program score on Link's Devaluation-Discrimination 
Scale, and social distance were included in the final logis- 
tical regression model as potentially-significant independent 
variables. This study demonstrated that the pre-program 
level of stigma was a significant explanatory variable. Ac- 
cording to a previous study on anti-stigma education, 
lower levels of understanding and a more negative attitude 
towards mental illness allowed more potential for im- 
provement following the program [28] . It can therefore be 
inferred that parents with higher stigma levels before the 
program are more likely to view schizophrenia more posi- 
tively after watching the program. This result is shown by 
the logistic regression presented in Table 3-2, and also by 
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the distribution comparison of pre- and post-program 
Link's Devaluation-Discrimination Scale scores shown in 
Table 2. 

In this study, some parents did not change their atti- 
tudes towards schizophrenia. There are two possible 
causes of stigma not changing. One is the increase of 
stigma synchronized with the improvement of know- 
ledge about schizophrenia. In this study, increases in 
levels of stigma tended to occur among parents who had 
more knowledge before watching the program. This is 
consistent with some previous studies that have indi- 
cated that stigma towards mental illness increases with 
increased knowledge [29-32]. For example, research in 
2013 by Loch et al. reported that the more information 
people were given about schizophrenia, the more nega- 
tively they viewed the illness [29]. The reason might be 
that many laypeople do not have the opportunity to con- 
nect with the real condition of schizophrenia. Therefore, 
these "knowledgeable" people actually know little about 
the daily life of people with schizophrenia after only read- 
ing written descriptions, and they consequently retain their 
original attitudes towards schizophrenia. The second pos- 
sible reason is that the content of the educational program 
might make the audience hesitate, become discouraged, or 
feel hopeless because of the complexity and incomprehen- 
sibility of schizophrenia. This "side effect" of schizophrenia 
literacy has been confirmed by several recent studies 
[31-33], and might explain why levels of stigma towards 
schizophrenia sometimes remain unchanged or worsen 
following an educational program [34,35]. Specially, as par- 
ents of adolescents confront this complicated illness, asso- 
ciating the symptoms with negative aspects of people with 
schizophrenia, their fear of the illness and worries about 
their children may be stimulated. 

The above perspectives confirm that simple knowledge- 
imparting programs are not always effective in decreasing 
stigma. Similar results were also found in Hong Kong and 
the United States [10,36]. Alternatively, several studies 
have demonstrated that interpersonal contact with stigma- 
tized people is a recognized effective strategy for reducing 
public stigma, indicating that the combination of know- 
ledge and contact should be an effective method to inten- 
sify the educational effect of programs seeking exclusively 
to impart knowledge [35,37]. 

There are several possible methods of reducing levels of 
stigma. In line with the above discussion about the associ- 
ation between employment status and stigma changes and 
the importance of supplementing knowledge communica- 
tion with contact for parents of middle and high school stu- 
dents, two types of anti-stigma interventions could be 
conducted in the future. One involves increasing contact in 
daily life with people with schizophrenia. Most laypeople 
lack opportunities to absorb knowledge and make personal 
contact with people suffering from schizophrenia, especially 



if their contact opportunities are limited by their employ- 
ment status. Suitable ways of encouraging this kind of 
contact might be lectures by psychiatrists and people with 
or recovered from schizophrenia in community centers or 
parents' meetings at school. The second type of anti- 
stigma intervention involves incorporating contact with 
people with schizophrenia within the educational program 
itself. It is possible to include interview videos of people 
who suffered from schizophrenia as adolescents and their 
parents, who could talk about the experiences of their ac- 
tual daily lives and effective treatment methods. These 
positive examples could make parents hopeful regarding 
the treatment of schizophrenia and aware of the import- 
ance of early detection and treatment. Furthermore, im- 
proving the law and insurance systems in primary and 
secondary industries could make people more willing and 
relaxed regarding the possibility of working with people 
with schizophrenia, thus reducing the stigma among this 
population [38-40]. 

This study also has several limitations, and some of 
the conclusions drawn here will lead to further debate. 
First, because the invitation to take part in the survey 
and the viewing of the educational program were con- 
ducted over the internet, parents who frequently used 
the internet were more likely to be included in the sam- 
ple. Therefore, the sample in this study may not be rep- 
resentative of the wider population because of the 
nature of internet-based surveys, which makes the oc- 
currence of non-response inevitable. Of the 5,000 candi- 
dates for participation in this study, 2,310 parents did 
not respond. For these parents, we were unable to obtain 
agreement to participate or any data regarding their 
characteristics, and it is possible there are some differ- 
ences between respondents and non-respondents in 
terms of characteristics and attitudes. Second, regional 
cultural and psychological factors were not considered 
as explanatory variables of the effects. These would be a 
valuable consideration future studies. Third, the result of 
this study, with almost equal numbers of participants 
in the stigma-increased (n = 550) and stigma-decreased 
(n = 508) groups, underlines the fact that the theory of 
how educational efforts can affect stigma changes is in 
need of further development. However, the primary ob- 
jective of this study was to explore the factors related to 
the characterization of considerably decreasing or increas- 
ing stigma using appropriate statistical analyses, and the 
results suggest that our educational program resulted in 
considerable decreases in stigma for participants with 
specific characteristics. This finding has encouraged us 
to conduct further studies. Concretely, we need to evalu- 
ate the reproducibility of the findings on the stigma- 
decreasing effect of our educational program for the 
Japanese parents of adolescents with certain characteris- 
tics. Additionally, it is necessary for us to investigate the 
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cause of increasing stigma for the other parents in detail 
and to consider whether there are alternative strategies to 
prevent the considerable increases in stigma observed 
among some parents in this study. In particular, it is es- 
sential that future research give more deliberate consider- 
ation to strategies for anti-stigma education for parents 
with a variety of characteristics. 

Conclusions 

The results of this study suggest that participants' em- 
ployment status, occupation, basic knowledge of schizo- 
phrenia, initial Link's Devaluation-Discrimination Scale 
score, and social distance were significant factors associ- 
ated with the likelihood of a considerable decrease in 
stigma towards schizophrenia as a result of the educa- 
tional program. The results of the analysis presented in 
this article have several implications in terms of promis- 
ing methods for future anti-stigma education efforts. 
For example, contact with people with schizophrenia 
in daily life would likely be effective for parents whose 
interpersonal contacts are limited, video contact with ado- 
lescents with schizophrenia and their parents might encour- 
age hopefulness and awareness regarding schizophrenia 
among parents, and the improvement of the law and 
insurance systems would intensify the sense of secur- 
ity of parents working in primary and secondary in- 
dustries, consequently decreasing the fear and stigma 
associated with schizophrenia. 

Additional file 



Additional file 1: The Link Devaluation-Discrimination Scale 
(modified for schizophrenia) (4: strongly agree, 3: tend to agree, 
2: tend to disagree, and 1: strongly disagree). 



Competing interests 

The authors declare that they have no competing interests. 
Authors' contributions 

YL was the principal investigator and was responsible for the study concept 
and design, was involved in the data management, carried out the statistical 
analyses, and drafted the manuscript. MW was involved in drafting the 
manuscript. HY conducted the data collection and was involved in the data 
management. KA supervised the first author and was involved in interpreting 
the data and drafting the manuscript. All authors revised the text critically for 
important intellectual content and read and approved the final manuscript. 

Acknowledgements 

The authors thank the study participants. This work was supported by a 
Grant-in-Aid for Scientific Research from the Japan Society for the Promotion 
of Science, Ministry of Education, Culture, Sports, Science and Technology in 
Japan. 

Author details 

'Department of Medical Informatics, Niigata University Medical and Denta 
Hospital, Asahimachi-Dori 1-754, Niigata 951-8520, Japan, department of 
Health, Faculty of Health Science, Tsukuba University of Technology, Tsukuba, 
Japan. 3 School of Health Sciences, Faculty of Medicine, Tohoku University, 
Sendai, Japan. 



Received: 5 November 2013 Accepted: 27 February 2014 
Published: 18 March 2014 



References 

1. Cornblatt BA, Lencz T, Smith CW, Correll CU, Auther AM, Nakayama E: The 
schizophrenia prodrome revisited: a neurodevelopmental perspective. 
Schizophr Bull 2003, 29:633-651. 

2. Vourdas A, Pipe R, Corrigall R, Frangou S: Increased developmental 
deviance and premorbid dysfunction in early onset schizophrenia. 
Schizophr Res 2003, 62:13-22. 

3. Pinto-Foltz MD, Cynthia Logsdon M: Conceptual model of research to 
reduce stigma related to mental disorders in adolescents. Issues Merit 
Health Nurs 2009, 30:788-795. 

4. Cooper-Patrick L, Powe NR, Jenckes MW, Gonzales JJ, Levine DM, Ford DE: 
Identification of patient attitudes and preferences regarding treatment 
of depression. J Gen Intern Med 1997, 12:431-438. 

5. Bechard-Evans L, Schmitz N, Abadi S, Joober R, King S, Malla A: 
Determinants of help-seeking and system related components of 
delay in the treatment of first-episode psychosis. Schizophr Res 2007, 
96:206-214. 

6. Pinto-Foltz MD, Logsdon MC: Reducing stigma related to mental 
disorders: initiatives, interventions, and recommendations for nursing. 
Arch Psychiatr Nurs 2009, 23:32-40. 

7. Corrigan PW, Morris SB, Michaels PJ, Rafacz JD, Rusch N: Challenging the 
public stigma of mental illness: a meta-analysis of outcome studies. 
Psychiatr Serv 201 2, 63:963-973. 

8. Yoshii H, Watanabe Y, Kitamura H, Chen J, Akazawa K: Effect of an 
education program on improving knowledge of schizophrenia among 
parents of junior and senior high school students in Japan. BMC Public 
Health 2011, 11:323. 

9. Heather S: Reaching out to high school youth: the effectiveness 
of a video-based antistigma program. Can J Psychiatry 2006, 
51:647-653. 

10. Chan JY, Mak WW, Law LS: Combining education and video-based contact 
to reduce stigma of mental illness: 'The Same or Not the Same" 
anti-stigma program for secondary schools in Hong Kong. Soc Sci Med 
2009, 68:1521-1526. 

1 1 . Yoshii H, Watanabe Y, Kitamura H, Nan Z, Akazawa K: Stigma toward 
schizophrenia among parents of junior and senior high school students 
in Japan. BMC Res Notes 201 1, 4:558. 

12. Link BG: Understanding labeling effects in the area of mental disorders: 
an assessment of the effects of expectations of rejection. Am Sociol Rev 
1987, 52:96-112. 

13. Brohan E, Elgie R, Sartorius N, Thornicroft G: Self-stigma, empowerment 
and perceived discrimination among people with schizophrenia in 14 
European countries: the GAMIAN-Europe study. Schizophr Res 2010, 

122:232-238. 

14. Scocco P, Castriotta C, Toff o I E, Preti A: Stigma of Suicide Attempt (STOSA) 
scale and Stigma of Suicide and Suicide Survivor (STOSASS) scale: 

two new assessment tools. Psychiatry Res 2012, 200:872-878. 

15. American Psychiatric Association: Diagnostic and Statistical Manual of Mental 
Disorders (4th ed. Text Revision (DSM-IV-TR)). Washington DC: American 
Psychiatric Association; 2000. 

16. Karakayali N: Social distance and affective orientations. Sociol Forum 2009, 
23:538-562. 

1 7. Whatley CD: Social attitudes towards discharge mental patients. Soc Probl 
1959, 6:313-320. 

18. Lysaker PH, Roe D, Yanos PT: Toward understanding the insight paradox: 
internalized stigma moderates the association between insight and social 
functioning, hope, and self-esteem among people with schizophrenia 
spectrum disorders. Schizophr Bull 2007, 33:192-199. 

19. Berge M, Ranney M: Self-esteem and stigma among persons with 
schizophrenia: implications for mental health. Care Manag J 2005, 
6:139-144. 

20. Akazawa K, Nakamura T, Palesch Y: Power of logrank test and Cox 
regression model in clinical trials with heterogeneous samples. Stat Med 
1997, 16:583-597. 

21. Herek GM, Capitanio JP, Widaman KF: HIV-related stigma and knowledge 
in the United States: prevalence and trends, 1991-1999. Am J Public 
Health 2002, 92:371-377. 



Ling ef al. BMC Public Health 2014, 14:258 Page 10 of 10 

http://www.biomedcentral.com/1471-2458/14/258 



22. Japanese Health, Labour and Welfare Ministry: Health care and welfare 
measures for persons with disabilities, http://www.mhlw.go.jp/english/ 
wp/wp-hw6/dl/09e.pdf. 

23. Hori H, Richards M, Kawamoto Y, Kunugi H: Attitudes toward 
schizophrenia in the general population, psychiatric staff, physicians, 
and psychiatrists: a web-based survey in Japan. Psychiatry Res 201 1, 
186:183-189. 

24. Mas A, Hatim A: Stigma in mental illness: attitudes of medical students 
towards mental illness. Med J Malaysia 2002, 57:433-444. 

25. Scheid TL Stigma as a barrier to employment: mental disability and the 
Americans with Disabilities Act. Int J Law Psychiatry 2005, 28:670-690. 

26. Coppens E, Van Audenhove C, Scheerder G, Arensman E, Coffey C, Costa S, 
Koburger N, Gottlebe K, Gusmao R, O'Connor R, Postuvan V, Sarchiapone M, 
Sisask M, Szekely A, van der Feltz-Cornelis C, Hegerl U: Public attitudes 
toward depression and help-seeking in four European countries baseline 
survey prior to the OSPI-Europe intervention. J Affect Disord 201 3, 
150:320-329. 

27. Chandra A, Minkovitz CS: Stigma starts early: Gender differences in teen 
willingness to use mental health services. J Adolesc Health 2006, 38:754. 

28. Gaebel W, Zaske H, Baumann AE, Klosterkotter J, Maier W, Decker P, Mbller 
HJ: Evaluation of the German WPA "program against stigma and 
discrimination because of schizophrenia-Open the Doors": results from 
representative telephone surveys before and after three years of 
antistigma interventions. Schizophr Res 2008, 98:1 84-1 93. 

29. Chou KL, Mak KY: Attitudes to mental patients among Hong Kong Chinese: 
a trend study over two years. Int J Soc Psychiatry 1 998, 44:215-224. 

30. Kvaale EP, Haslam N, Gottdiener WH: The 'side effects' of medicalization: 
a meta-analytic review of how biogenetic explanations affect stigma. 
Clin Psychol Rev 2013, 33:782-794. 

31. Kvaale EP, Gottdiener WH, Haslam N: Biogenetic explanations and stigma: 
a meta-analytic review of associations among laypeople. Soc Sci Med 
2013,96:95-103. 

32. Read J, Haslam N, Sayce L, Davies E: Prejudice and schizophrenia: a review 
of the 'mental illness is an illness like any other' approach. Acta Psychiatr 
Scand 2006, 114:303-318. 

33. Angermeyer MC, Holzinger A, Carta MG, Schomerus G: Biogenetic 
explanations and public acceptance of mental illness: Systematic review 
of population studies. Br J Psychiatry 201 1, 199:367-372. 

34. Wegner DM, Schneider DJ: Mental control: the war of the ghosts in the 
machine. In Unintended Thought Edited by Uleman J, Bargh J. New York: 
Guilford Press: 1989:287-305. 

35. Corrigan PW, River LP, Lundin RK, Penn DL, Uphoff-Wasowski K, Campion J, 
Mathisen J, Gagnon C, Bergman M, Goldstein H, Kubiak MA: Three strategies 
for changing attributions about severe mental illness. Schizophr Bull 2001, 
27:187-195. 

36. Corrigan PW, Kerr A, Knudsen L: The stigma of mental illness: explanatory 
models and methods for change. Appl Prev Psychol 2005, 11:1 79—1 90. 

37. Graves RE, Chandon ST, Cassisi JE: Natural contact and stigma towards 
schizophrenia in African Americans: is perceived dangerousness a threat 
or challenge response? Schizophr Res 201 1, 130:271-276. 

38. Loch AA, Hengartner MP, Guarniero FB, Lawson FL, Wang YP, Gattaz WF, 
Rbssler W: The more information, the more negative stigma towards 
schizophrenia: Brazilian general population and psychiatrists compared. 
Psychiatry Res 201 3, 205:1 85-1 91 . 

39. Schomerus G, Schwahn C, Holzinger A, Corrigan PW, Grabe HJ, Carta MG, 
Angermeyer MC: Evolution of public attitudes about mental illness: 

a systematic review and meta-analysis. Acta Psychiatr Scand 2012, 
125:440-452. 

40. Angermeyer MC, Holzinger A, Matschinger AH: Mental health literacy and 
attitude towards people with mental illness: a trend analysis based on 
population surveys in the eastern part of Germany. Eur Psychiatry 2009, 

24:225-232. 



doi:10.1 186/1471-2458-14-258 

Cite this article as: Ling ef al:. Characteristics linked to the reduction of 
stigma towards schizophrenia: a pre-and-post study of parents of 
adolescents attending an educational program. BMC Public Health 
2014 14:258. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at f \ n! _, ul _-| r Q r,tr=l 

www.biomedcentral.com/submit B,onne «« central 



